On-device AI products need a runtime that brings together models, providers, resource policy, tool calls, and observability.